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(57) The present Invention is to protect the right of 
portrait or privacy of people (10B to IGF) other than a 
spec'rfic person (1 OA), and to enable easy recognition of 
infomnation other than the face (11) of the specific per- 
son (1 OA) and the situation around the specific person 
(10A). Images videotaped by the sun/elllance cameras 
(1) are captured in the computer (3), face images are 
detected therefrom, and the detected face images are 
compared with the face image of a specific person (1 OA) 
registered in the storage devk:e (5). As the results of the 



comparison, when these face images do not match with 
each other, a mosaic process (12) is applied exclusively 
to the detected face images to protect the prrvacy of the 
people (10B to IGF) other than the specific person 
(1GA), whereas the mosaic process (12) is not applied 
to the parts other than the faces, such as dress and bag- 
gage, thereby keeping them as they are. When these 
face images match with each other, the face image of 
the specific person (1 GA) is not applied with the mosaic 
process (12), thereby keeping his or her face (11) and 
remaining parts as they are. 



Fig. 5 
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Description 

BACKGROUND OF THE INVENTION 
Technical Field 

[0001] The present Invention relates to a face identi- 
fication technique which detects human faces from im- 
ages talcen by a camera and compares themwith a pre- 
viously registered face, thereby detec^'ng a specific per- 
son. 

Related Background Art 

[0002] In order to search for a specific person like a 
criminal on the wanted list, such a system is available 
that videotapes an unspecified number of the general 
public and records their images by installing surveil- 
lance cameras in airports, stations, shopping centers, 
busy streets, and the like. In this system, videotaped Im- 
ages are recorded as they are or face images are ex- 
clusively recorded by being extracted from the video- 
taped images. In these methods, there is a problem that 
face images of the people other than the specific person 
are also recorded, failing to protect their rights of portrait 
or privacy. 

[0003] Therefore, there is a system now available, ac- 
cording to whbh the face image of a person videotaped 
by a surveillance camera is compared with the face Im- 
age of the specific person registered: the face image of 
a videotaped person is recorded if these face images 
match with each other, whereas when these face imag- 
es do not match with each other, the face image of the 
videotaped person is abandoned. In this system, out of 
the face Images videotaped, those whteh do to match 
with the face image of the registered specif k: person are 
not kept, thereby securing protection of their privacy. 
[0004] However, in the at>ove-described system, what 
is recorded is only the face image matching with the face 
image of the specif k; person, and other useful infonma- 
tton including the dress and baggage of the specific per- 
son and the situation around hinri or her are lost. As a 
result, when there Is a match and a responsible official 
rushes to the display monitor by a report or when re- 
corded images are confirmed later, the at>sence of in- 
fomiation other than his or her face makes It diff cult to 
search for the specific person. 
[0005] On the other hand, in order to protect individ- 
uals* privacy, there is an approach of applying a mosaic 
process on face images as described in Japanese Laid- 
Open Patent Application No. 2001-86407. However, In 
this patent applk»tion, skin color is detected from vide- 
otaped human Images and a mosaic process is auto- 
matically applied to face images, whk:h forces all face 
images videotaped to be applied with a nrtosak: process, 
thereby making it impossible to apply a mosak: process 
to the face Images excluding the face Image of the spe- 
cific person. 



[0006] Japanese Laid-Open Patent Application No. 
2000-216 also discloses privacy protection nneasures 
by applying a mosaic process to human body Images. 
However, when the technique of this patent application 
5 Is used to protect the privacy of the people other than 
the specific person, it is difficult to check the situation 
around the specific person, because the whole image 
of the specific person is applied with the mosak: proc- 
ess. 

10 ' 

DISCLOSURE OF THE INVENTION 

[0007] The present invention, which is Intended to 
solve the aforementioned problems, has the object of 

'5 facilitating confinrnatlon of infonnatbn other than the 
face of a specific person and situation around the spe- 
dffc person, while protecting the right of portrait or pri- 
vacy of the people other than the specif k: person. 
[0008] The face identification device of the present in- 

20 vention comprises: detection means for detecting face 
Images from human body images taken by a camera; 
storage means in whbh a face image of a spedfk: per- 
son is previously stored; detennination means for deter- 
mining whether a face image detected by the detection 

25 means matches with the face image stored in the stor- 
age means by comparing both face images; and ab- 
straction means for applying an ak>straction process to 
a predetermined face image out of the face images de- 
tected by the detection means in order to make the pre- 

30 determined face image unrecognizable. The at>straction 
means applies the abstraction process exclusively to a 
detected face image when the determination means de- 
termines that both face Images do not match with each 
other. On the other hand, the at>straction means does 

35 not apply the at>stractlon process to a detected face im- 
age when the determinatk>n means determines that 
both face Images match with each other. 
[0009] The face kientlfication method of the present 
Invention comprises the steps of: detecting face Images 

^ from human body images taken by a camera; determin- 
ing whether a detected face image matches with the 
face image previously stored by comparing both face 
Images; applying an abstraction process exclusively to 
a detected face image in order to make the detected 

^ face Image unrecognizable, when it Is determined that 
both face images do not match with each other; and not 
applying the ak>stFactlon process to the detected face 
image when it is determined that both face images 
match with each other. 

so [001 0] The temri "match" referred to in the above de- 
scription means not only a complete match between a 
deteded face Image and the face Image previously 
stored, but also a high degree of resemblance between 
these face images. 

^ [001 1] According to the present invention, when a de- 
tected face image and the registered face Image do not 
match with each other, that Is, when the detected face 
does not belong to the specifk: person, an abstractk>n 
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process is applied on the face image in order to protect 
the right of portrait or privacy of the people other than 
the specific person. Furthemnore, the abstraction proc- 
ess is applied only to the face images of the people, 
keeping Images other than their faces, such as their 
dress and baggage. On the other hand, when a detected 
face image and the registered face image match with 
each other, that is, when the detected face belongs to 
the specific person, both the face image and images in- 
cluding the dress and baggage of the specific person 
are kept without being applied with the abstraction proc- 
ess. Thus keeping the images for the dress and bag- 
gage of a specific person and of the other people as they 
are can facilitate the search for the specific person by 
using these images as an Important due. 
[001 2] A typical example of the abstraction process In 
the present invention is a mosaic process. The use of 
the well-known mosaic process can abstract face imag- 
es easily. Besides the mosab process, various other 
methods are available for abstrac^on, such as blurring 
or filling in face image portions. 
[001 3] I n the present inventk)n, when it Is detemiined 
that a detected face image matches with the stored face 
image, a marker is applied to the detected face image 
portion instead of applying an abstraction process there- 
to. The application of a marker makes a specific person 
distinguishable at a glance. 

[001 4] I n the present i nvention, when it is detemiined 
that a detected face image matches with the stored face 
image, the Image of the specific person applied with the 
abstraction process neither to his or her face nor remain- 
ing parts and the Images of the other people applied with 
the abstractk>n process exclusively to their faces are 
displayed. At the same time, a warning is outputted. This 
system realizes a quk:k response because the waming 
is outputted at the time erf the detection of a specifk: per- 
son. Conceming a specific person, the videotaped Im- 
age is displayed as it is, and as for the people other than 
the specifc person, the at>straction process is applied 
to their faces to prote<^ their privacy white the images of 
their dress and l:)aggage are displayed as they are. This 
makes it possible to obtain useful information about the 
specific person and the situation around him or her. 
thereby fadlitating the search for the specrfb person. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0015] 

Fig. 1 shows a block diagram of the face identif 
tion system to whteh the present invention is ap- 
plied. 

Fig. 2 shows af iowchart depk:ting the procedure for 

registering face images. 

Fig. 3 shows a flowchart depcting the procedure of 
the face identifk»tion method of the present inven- 
tton. 

Fig. 4 shows a flowchart deputing a specinc proce- 



dure of identification. 

Fig . 5 shows an image example to which mosak; 
process has been applied. 
Fig. 6 shows a flowchart depicting the identifbation 
5 procedure in the case where a face image Is regis- 
tered afterwards. 

Fig. 7 shows a flowchart depicting another embod- 
iment of the face identification method. 
Rg. 8 shows a flowchart depicting the identif Nation 
10 procedure in the case where a face image is regis- 
tered afterwards in another embodiment. 
Rg. 9 shows a block diagram showing another em- 
bodiment of the present invention. 

15 DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0016] Rg. 1 shows a block diagram of the face iden- 
tificatton system to which the present invention is ap- 

^ plied. In the drawing, the face identifk:ation system is 
composed of surveillance cameras 1 for videotaping the 
images of people, and the face ldentifk»tion devtce 2 of 
the present invention for identifying face images of the 
people vkieotaped by the surveillance cameras 1 . Aplu- 

25 ral number of the surveillance cameras 1 are installed 
in airports, stations, shopping centers, busy streets, and 
other places where a number of people gather, and each 
of the cameras 1 is con nected with the face identif bation 
devce 2 installed in a monitor center or the like. 

30 [0017] In the face identifk»tion device 2, reference 
numeral 3 Is a computer forf ace Identification; reference 
numeral 4 is an Identifteation results output device for 
outputting the results of face identifbation by the com- 
puter 3; and reference numeral 5 is a storage devk>e 

35 whk^h previously stores the face image data of a specifk: 
person (e.g., a suspect on the wanted list). Reference 
numerals 6 and 7 are Image Input devk^es for registering 
a face image to the storage device 5: reference numeral 
6 is a scanner and reference numeral 7 is a digital cam- 

^ era. The computer 3 indudes detection means for de- 
tecting face images from Images of people videotaped 
by the surveillance cameras 1 ; determination means for 
detenninlng the presence or at>sence of a match be- 
tween a detected face image and the face image stored 

^ in the storage device 5 by comparing them; and abstrac- 
tion means for applying an at>straction process to a pre- 
detemnlned face Image out of the detected face images 
so as to make the face unrecognizable. The identifica- 
tion results output device 4 is composed of a display 

50 monitor for displaying identification results, a printer for 
printing identification results, and other output devices. 
The storage devk» 5 can be a hard disk or the like, 
which composes the storage means of the present in- 
vention. Beskies a hard disk, an optical disk C€m be used 

55 as the storage means. 

[0018] Operatk>n of the face identifk^tion system 
having the above-explained structure will be described 
as follows. In this system, the face image of a specifk: 
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person is previously registered in the storage device 5. 
Fig. 2 shows a flowchart depicting the procedure of face 
image registration, which is executed by the computer 
3. At first, an Image Including the face of a specific per- 
son to be registered Is captured into the computer 3 from 
the scanner 6 or the digital camera 7 (Step S1). Next, 
the face to be registered is detected from the captured 
image (Step S2). This face detection can be done by 
using a well-known approach, such as skin color detec- 
tion, abstractk>n of difference with a background Image, 
or abstraction of face likelihood from pattem matching. 
After the face detection, featuring points such as eyes, 
nose, mouth, and ears are detected from the face image 
(Step S3) , and the amount of feature about the shape 
and position of each detected featuring point is extract- 
ed (Step S4). This abstraction of feature amount also 
can be done by using a well-known approach, such as 
extraction of the annount of feature from gray-scale inr>- 
ages Including eyes, nose, mouth, and ears by template 
matching. The amount of feature extracted is stored and 
registered In the storage device 5 as face image data 
(Step S5). 

[0019] Fig. 3 shows a flowchart depicting the proce- 
dure of the face identification method of the present In- 
vention, the procedure being executed by the computer 
3. In the computer 3 , images videotaped by the surveil- 
lance cameras 1 are captured as still Images at the in- 
terval of e.g. one second (Step S11), and human faces 
are detected from the captured Images (Step SI 2). If 
there is no face detected (Step S13:NO), the process 
goes back to Step S11 and captures images In the next 
timing. If a face Is detected (Step S13:YES), the detect- 
ed face image is compared with the face Image previ- 
ously registered In the storage device 5 (Step SI 4) so 
as to determine whether or not these face images match 
with each other (Step S15). 

[0020] Fig. 4 shows a flowchart depicting the specific 
procedure of the comparison in Step S14 . In the com- 
parison, featuring points (eyes, nose, mouth, and the 
like) are detected from the detected face image (Step 
S31), and the amount of feature about the shape and 
position of each detected featuring point is extracted 
(Step S32). The extracted amount of feature is com- 
pared with the amount of feature of the face registered 
In the storage devk:e 5 (Step S33). Based on the com- 
parison results. It is determined whether these face im- 
ages match with each other or not at Step SI 5 shown 
in Fig. 3. The term "match" referred to in this case means 
not only a complete match, but also a high degree of 
resemblance between these face images. To be more 
specific, the degree of resemblance is calculated from 
the amount of feature of each face Image, and is com- 
pared with a predetermined threshold value. When the 
degree is equal to or over the threshold value, it is de- 
termined as a match. 

[0021 ] As the results of the determination at Step SI 5, 
when a detected face image and the registered face im- 
age do not match with each other (Step S15:NO), the 



detected face image does not belong to the specifb per- 
son registered. Therefore, the mosaic process is applied 
to the detected face image portion (Step SI 6). Fig. 5 
shows an example of images to which the mosaic proc- 

5 ess has been applied: the mosaic process 1 2 Is applied 
to each face image of the persons 10B to 10F except 
the specific person so as to abstract their faces unrec- 
ognizably. The mosaic process 12 is applied exclusively 
to the face Image portions, keeping dress and baggage 

10 portions unprocessed. 

[0022] On the other hand, when a detected face im- 
age matches with the registered face image (Step SI 5: 
YES), it means that the detected face image belongs to 
the registered specific person, so a marker Is applied to 

15 the detected face image portion instead of applying the 
mosaic process thereto (Step SI 7). In Fig. 5, the person 
10A is the specific person, and the mosak: process 12 
is not applied to the face image portion of the specify 
person 10A, thereby keeping the face 11 the same as 

20 when it is videotaped by the surveillance cameras 1. The 
face 11 Is enctosed by the mariner 13 to make the spe- 
cif k; person distinguishable at a glance. The mosak: 
process 12 is not applied to the dress or baggage of the 
spedf k: person 1 0A. In other words, concerning the spe- 

25 dfki person 1 0A, the image videotaped by the surveil- 
lance cameras 1 appears as it is. 
[0023] After the process In Step SI 7, the identif Nation 
results output device 4 displays, with a waming, the im- 
ages shown in Fig. 5 including the Image of the specif b 

30 person 1 0A whose face and remaining parts are not ap- 
plied with the mosate process 1 2, and the images of the 
persons 1 0B to 1 0F whose faces are exclusively applied 
with the mosak: process (Step SI 8). This waming is dis- 
played as a message including the name of the specifk: 

35 person, the time and date of the image videotaped, and 
the place videotaped. Furthermore, an alarm Is Issued 
as necessary with the display in order to draw the re- 
sponsft>le offrciafs attention. This enables the offk:ial to 
prepare the deployment of members for the search for 

^ the specific person. 

[0024] Since the faces of the people other than the 
spectfk: person 1 0A are applied with the mosak: process 
12 as shown in Fig. 5, when the images are displayed 
on the display monitor, there is no fear of violating their 

^ rights of portrait or privacy. Furthermore, the mosac 
process 1 2 Is applied exclusively to their faces, keeping 
the remaining parts unprocessed, whk:h enables easy 
recognitton of the dress and baggage of the people 
around the specific person 1 0A. On the other hand, con- 

50 ceming the specify person 10A, the videotaped image 
of the whole body appears as it Is, nriaklng it possible to 
confirm his dress and baggage In addition to his face. 
Thus, the mosak: process 12 is applied exclusively to 
face portions whk:h raise the issue of prrvacy, and the 

55 remaining parts are kept the same as when they are vid- 
eotaped, thereby f adlrtating the search for the speclfk: 
person 1 0A by using the dress and baggage as a useful 
clue. 
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[0025] After Steps S1 6 to S1 8 are executed, it is de- 
termined whether matching is done for all the detected 
tabes (Step S19). When there is still a face to be 
checked (519:NO) the process goes back to Step S14 
to check the next face. When ail the detected faces have 5 
been checked (S19:YES) , the image to whk^h the pro- 
cedure of Steps SI 6 and SI 7 has been applied is re- 
corded to the storage device 5 (Step S20). Later, the 
process goes back to Step S11 , and videotaped images 
are captured from the surveillance cameras 1 again in io 
the next timing (in one second in this case) . Hereafter, 
the procedure In Steps SI 2 to S20 is repeated. 
[0026] The above example describes the case where 
images videotaped by the surveillance cameras 1 are 
captured as stiil images at the Interval of one second; is 
however, it is also possible to adopt a system which de- 
tects human faces from motion images videotaped by 
the surveillance cameras 1 and checks the faces while 
automatically chasing them. In this system, there is no 
need for the repeated recording of the image of the 
same person, whk:h can reduce the amount of image 
data to be recorded in the storage devk» 5, thereby en- 
abling miniaturization of the storage device 5. 
[0027] Images stored in the storage devbe 5 can be 
outputted by being displayed or printed by the identifl- 25 
cation results output device 4 later at any point in time. 
In this case, too. the privacy of the people other than the 
specific person 1 0A is protected by applying the mosaic 
process to their faces, whereas the images for the dress 
and baggage including those of the specific person are 30 
stored as they are. This infonfnatlon can be used as a 
due to facilitate the search for the specific person 10A. 
[0028] In the aforementioned embodlmentp the face 
image of a specific person is previously registered, and 
face images videotaped by surveillance cameras are 35 
compared with the registered face image so as to detect 
the speclfb person; however, it is also possible to detect 
a specific person registered afterwards by using images 
stored in the storage devtee 5. This system enables the 
detection of people whom the poltee has been request- ^ 
ed to find or stray children. 

[0029] Fig. 6 shows a flowchart depicting the proce- 
dure of identifk:ation in the case of registering after- 
wards as descrik>ed at>ove, the procedure being execut- 
ed by the computer 3 . At first, images stored in the stor- ^ 
age device 5 are captured by the computer 3 (Step S41 ) . 
The images stored in the storage devk» 5 are unrecog- 
nizable because of the at)ove-descrit)ed mosak; proc- 
ess, so it is necessary to reconstruct the original images 
for comparison. Therefore, the rnosac process is so 
cleared to reconstruct the original images (Step S42). 
After the reconstruction of the original images, faces are 
detected from the reconstmcted images (Step S43) . If 
no face is detected from the reconstructed images (Step 
S44:NO), the process goes back to Step S41 to capture ss 
recorded images. On the other hand, if faces are detect- 
ed from the reconstmcted images (Step S44:YES), de- 
tected face images are compared with the face image 



which is registered afterwards (Step S45). The face im- 
age registered afterwards is taken by the scanner 6 or 
the digital camem 7 and recorded to the storage device 
5 in the same manner as the previously registered case. 
P030] If the comparison results in Step S45 indteate 
that a recorded image face does not match with the face 
registered afterwards (Step S46:NO), it is determined 
whether all faces detected from the recorded images 
have been checked or not (Step S47). When there is a 
face left unchecked (Step S47:NO), the process goes 
back to Step S45 to check the next face. When all faces 
have been checked (Step S47:YES), it is determined 
whether all the recorded images have been checked or 
not (Step S48). If all recorded images are not checked 
(Step S48:NO), the process goes back to Step S41 to 
capture the next recorded image from the stomge de- 
vk» 5 and the aforementioned procedure is repeated. 
When the comparison for all recorded images is com- 
plete (Step 548: YES), the absence of the face image 
matching with the face Image registered afterwards is 
reported by being displayed on the display monitor of 
the identif»atk>n results output devk» 4 (Step S49). 
[0031] On the other hand, in Step S46, if a recorded 
face image matches with the face registered afterwards 
(Step S46:YES), the reconstructed original image is out- 
putted to the identifk:ation results output devk» 4 and 
shown on the display monitor (Step S50). And it is re- 
ported by being shown on the display monitor that there 
is a recorded face Image which matches with the face 
registered aftenwards (Step S51 ). 
[0032] In the comparison in the above-described case 
where a face image is registered afterwards, it is pref- 
erable in terms of security that the process for recon- 
structing original images by clearing the mosak; process 
applied to images stored in the storage devbe 5 can be 
done exclusively by an authorized person (e.g.y system 
administrator). Rgs. 7 and 8 show fk>wcharts deputing 
the emt>odiment of this case. 

[0033] Rg. 7 shows a flowchart corresponding to the 
flowchart shown in Fig. 3, so the same steps as those 
in Fig. 3 are ref en^ed to with the same symbols. The pro- 
cedure in Steps S11 to S19 is the same as iri Fig.3, so 
its explanation is omitted. When all faces have been 
checked in Step S19 (Step S19:YES), the face irhage 
of a recorder who records images is captured (Step 
S20a); the captured face image of the recorder is em- 
bedded as a "digital watemnaric" in the images proc- 
essed in Steps S16 and S17; and the images with the 
"digital watemnark" are stored in the storage device 5 
(Step S20b) . The term "recorder used in this case can 
be a system administrator, and tiie face image of the 
recorder whk:h is captured in Step S20a is previously 
taken by the scanner 6 or the digital camera 7 and stored 
in the storage devk» 5. 

[0034] The following is a description on the procedure 
for reconstructing original images. Fig. 8 shows a fk>w- 
chart connesponding to the flowchart of Rg. 6, so the 
same steps as those in Rg. 6 are referred to with the 
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same symbols. Rrst, images stored in the storage de- 
vice 5 are captured in the computer 3 (Step S41 ). Next, 
the face image of the operator who perfomris a recon- 
structing operation of images is captured (Step S41a). 
The face image of this operator Is taken by the scanner 5 
6 or the digital camera 7 at this point in time. Then, it Is 
determined whether the face image data captured in 
Step S41 a matches with the data of "digital watermark" 
embedded in the Images captured In Step S41 or not 
(Step S41b). If these pieces of data do not match with io 
each other (Step S41 b:NO), rt is determined that the op- 
erator who Is going to perfomi the reconstruc^ng oper- 
ation is not the above-mentioned recorder (systemad- 
ministrator), and the process is terminated. On the other 
hand, when these pieces of data match with each other f^ 
(Step S41 b:YES), It Is determined that the operator and 
the recorder (system administrator) are the same per- 
son, and the mosaic process is cleared to reconstmd 
the original images (Step S42). Since the procedure 
from Step S42 onward Is equal to the procedure in Rg. ^ 
6, the explanation will be omitted. 
[0035] As described hereinbefore, using the face im- 
age of the recorder as a "digital watemnark" makes It 
possible to authorize only the recorderto perfomn recon- 
struction and to prohibit an unauthorized third party from 25 
clearing a mosaic process to reconstruct original Imag- 
es, thereby securing the security. 
[0036] The present invention can adopt various other 
emt)odiments besides the embodiment described 
above. For example, in the above embodiment, a mo- 30 
sale process Is taken as an example of the abstraction 
process to be applied to face images; however, it is also 
possible to apply a process to blur face image portions, 
instead of applying the mosaic process. Aitematively, 
face Image portions can be filled In black or white, In- 3S 
stead of being applied with the mosaic process or the 
blurring process. 

[0037] in the above embodiment, images whk:h are 
videotaped by the surveillance cameras 1 and applied 
with a mosaic process or a marker are stored in the stor- 40 
age devrce 5; however, the images can be merely dis- 
played on the display monitor of the klentlfication results 
output device 4. In this case, there is no need for storage 
to the storage device 5. 

[0038] In the above embodiment, face images which 
are registered either previously or afterwards are stored 
in the storage devtee 5, and images which are video- 
taped by the surveillance cameras 1 and applied with a 
mosaic process or a marker are also stored in the same 
storage device 5. Altematively, as shown in Fig. 9, a spe- so 
clal image storage device 8 can be provided In addition 
to the storage devk:e 5 so that face Inrtages to be regis- 
tered can be stored in the storage devce 5 whereas im- 
ages videotaped by the surveillance cameras 1 can be 
stored in the image storage devk» 8. The image storage ss 
device 8 can be composed of any kind of device dealing 
with recording media such as a vkleo tape recorder, a 
DVD (Digital Versatile Disk) recorder, or a hard disk re-> 



corder. In that case, faces other than the face of the spe- 
cifk: person are applied with an abstractk>n process, so 
there is no fear of violating their rights of portrait or pri- 
vacy during reproduction. 

[0039] According to the present invention, an abstrac- 
tion process is applied exclusively to the face Images of 
the people other than a specific person, thereby protect- 
ing their rights of portrait or privacy, whereas the images 
for the dress and baggage of the specific person and 
the other people are kept as they are. This Information 
can be used as a clue to facilitate the search for the spe- 
cif k: person. 



Claims 

1. A face identification device (2) comprising: 

detection means for detecting face images from 
human body Images taken by a camera; 
storage means In which a face Image of a spe- 
ctfrc person (IDA) is previously stored; 
determination means for detemitning whether 
a face image detected by said detection means 
matches with the face image stored In said stor- 
age means by comparing both face images; 
and 

abstraction means for applying an abstraction 
process to a predetermined face image out of 
the face images detected by said detection 
means in order to make the predetennlned face 
image unrecognizable, 

said abstraction means applying the abstrac- 
tion process exclusively to a detected face im- 
age when said detemiinatlon means deter- 
mines that both face images do not match with 
each other, and not applying the ak)strBctk>n 
process to a detected face image when said de- 
termination means detenmines that both face 
innages match wrth each other. 

2. The face identification devk» (2) according to dalm 
1, wherein said abstraction process is a mosak: 
process (12) for making a face image portion mo- 
saic. 

3. The face identification devtee (2) according to claim 
1 or 2, wherein when said determination means de- 
temriines that both face images match with each 
other, a detected face Irnage is not applied with the 
at>stFactlon process and is applied with a maricer 
(13). 

4. The face identifk^ation device (2) according to any 
one of claims 1 to 3 , wherein when a face Image 
detected by said detection means is detemilned to 
match with the face Image stored In sakt storage 
means, the image of the specific person (10A) 
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which is not applied with the at>straction process on 
the face (11) and remaining parts thereof and the 
images of people (1 OB to 10F) other than the spe- 
cific person (10A) which are applied with the ab- 
straction process exclusively on the faces thereof s 
are displayed, and a waming is also outputted. 

5. A face identification method comprising the steps 
of: 

10 

detecting face images from human t>ody imag- 
es taken by a camera; 

detemriining whether a detected face image 
matches with the face image previously stored 
by comparing both face images; is 
applying an abstraction process exclusively to 
a detected face Image In order to make the de- 
tected face image unrecognizable, when It Is 
detemilned that both face images do not match 
with each other; and 20 
not applying the abstractton process to the de- 
tected face image when it Is detemiined that 
both face images match with each other. 
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